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Abstract 

Background: Accurate identification of Plasmodium infections in community surveys is essential to successful 
malaria control. Microscopy and rapid diagnostic tests (RDTs) are the main techniques used to diagnose malaria in 
field-based surveys. While microscopy is still considered the gold standard, RDTs are growing in popularity as they 
allow for rapid and inexpensive diagnosis. Using data from a prevalence survey conducted in north-western Angola 
in 2010, the authors aimed to compare the performance of microscopy and RDTs in identifying Plasmodium 
falciparum infections, using polymerase chain reaction (PCR) as the gold standard. 

Methods: Results from 3,307 subjects (1,225 preschool-aged children (zero to five year olds), 1,134 school-aged children 
(six to 1 5 year olds) and 948 mothers/caregivers (>1 5 years of age)), tested for P. falciparum infections, were utilized. The 
sensitivity, specificity, positive, and negative predictive values (PPV and NPV) of microscopy and Paracheck-Pf® were 
compared using the McNemar's test and the weighted generalized score Chi-squared test for paired data. 

Results: The prevalence of P. falciparum infections determined by PCR and microscopy was 1 5.9% and by Paracheck- Pf® 
was 16.3%. Compared to microscopy, Paracheck-Pf® had significantly higher sensitivity (72.8% versus 60%), specificity 
(94.3% versus 92.5%), PPV (70.7% versus 60%) and NPV (94.8% versus 92.5%). Both tests had significantly lower sensitivity in 
mothers (36.8% for microscopy and 43.7% for Paracheck-Pf®) than in their children (68.4% in zero to five years-old and 
60.6% in six to 15 years-old for microscopy and 80.4% in zero to five year-olds and 76.5% in six to 15 year-olds for 
Paracheck-Pf®). 

Conclusion: Both microscopy and RDTs performed suboptimally when compared to PCR. False negativity could be 
associated with the low parasite density profile of the samples. False positivity may be related to the well-described 
limitations of those techniques such as level of expertise of microscopists or persistent antigenicity from previous 
infections in the case of RDTs. Nevertheless, RDTs had enhanced performance comparatively to microscopy in detecting 
malaria infections, favouring their use in community cross-sectional malaria surveys, where expert performance of 
microscopy is hard to accomplish. 
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Background 

Active surveillance through field-based surveys is consid- 
ered a powerful tool for estimating the burden of malaria, 
as it identifies sustained foci of transmission perpetuated 
by asymptomatic carriers and low parasitaemia infections 
[1-3]. Accurate diagnosis of Plasmodium infections is 
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crucial for providing realistic estimates of the burden of 
malaria and preventing misinformed interventions [4,5]. 

Microscopy has been the method of choice in determin- 
ing the prevalence of malaria in epidemiologic surveys, 
allowing quantification and differentiation of Plasmodium 
species at low cost [6-8]. More recendy, rapid diagnostic 
tests (RDTs) were introduced as screening tools in field- 
based surveys, as they provide readily available results 
allowing for treatment in situ [6,9,10]. RDTs alone were 
used to monitor Plasmodium infections in malaria 
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surveillance programmes in Tanzania, Gambia, Bangladesh 
and in the 2006-2007 malaria indicator survey in Angola 
[11-14]. 

The choice between microscopy and RDTs is not al- 
ways clear-cut as the performance of both diagnostic 
techniques in operational conditions varies depending 
on transmission intensity, prevalence of infections, and 
parasite density [5,15-17]. Microscopy is reported to de- 
tect about 75% of malaria infections in high transmission 
areas, whereas in low transmission areas this method 
has been reported to miss up to 88% of infections [17]. 
Furthermore, the level of expertise of technicians, quality 
of the equipment, and workload may lead to inaccurate 
estimates of parasite density and species differentiation 
[4,7]. On the other hand, the performance of HRP2- 
immunochromatography-based RDTs is affected by the 
detection of persistent antigenicity from previous infec- 
tions, which leads to false positives and overestimate 
prevalence [10,18-20]. Moreover, deletions or mutations 
within the pfhrp-2 gene and the prozone effect may lead 
to false negatives [21-25]. Additionally, sensitivity of RDTs 
can vary due to their vulnerability to extreme temperature 
and high humidity occurring in field-based surveys [26]. 
Considering these limitations, the use of RDTs in malaria 
surveys is only advisable when used in comparison with 
microscopy, as recommended by WHO and performed in 
the majority of studies [9,10,18,27-29]. However, reliance 
on microscopy to measure the performance of RDTs 
should be approached with caution as this technique itself 
can be compromised by the limitations described above 
[1,30-32]. Alternatively, PCR is highly sensitive, detecting 
low parasitaemia cases missed by other techniques and 
easily reproducible [33-37]. Nevertheless, it is also highly 
expensive, time and labour consuming and therefore used 
in only a few studies for confirmation of prevalence data 
and to measure the accuracy of microscopy and RDTs 
[31,38-40]. 

Using data from a prevalence survey conducted in 
north-west Angola, this study compared the performance 
(assessed by sensitivity, specificity, positive, and negative 
predictive values (PPV and NPV)), of microscopy and 
Paracheck-Pf in the detection of Plasmodium falciparum 
infections, using PCR as the gold standard. 

Methods 

Study area 

The study was conducted in Bengo province, north- 
western Angola, in the Health and Demographic Surveil- 
lance System (HDSS) study area covered by the CISA 
project {Health Research Centre in Angola, translated) [41]. 
This is considered a meso-endemic malaria area with 
stable transmission intensity [42]. The main peak of mal- 
aria occurs in the rainy season, between November and 
May [11]. A recent study from the same geographical area 



reported that 97% of malaria infections are due to P. falcip- 
arum but all other human species are present either alone 
or in mixed infections. Almost 90% of malaria infections 
are due to P. falciparum alone, 6.5% to P. falciparum and 
P. malariae together, 3.7% due to P. ovale curtisi or P. ovale 
wallikeri alone or in combination with other species and 
1.1% due to P. vivax alone [43]. 

Sample collection 

Finger-prick blood samples for microscopy, Paracheck- 
Pf and PCR were collected from children and their 
mothers/caregivers, during a baseline field-based preva- 
lence survey implemented between May and August 
2010, as described by Sousa-Figueiredo et al. [6]. Of the 
3,339 participants initially enrolled in the survey, 3,307 
(1,225 preschool-aged children (zero to five year olds), 
1,134 school-aged children (six to 15 year olds) and 948 
mothers/caregivers (>15 years of age), were tested by the 
three techniques and included in the present study. No 
clinical assessment of the participants was done at the 
time of recruitment. 

Team training 

The laboratory diagnosis team was composed of five tech- 
nicians with pre-university training and previous work ex- 
perience in public and private health units. A five-day 
retraining course was provided by the CISA project resi- 
dent laboratory experts and included theoretical and prac- 
tical sessions on: finger prick blood collection, thick and 
thin blood smear preparation, Giemsa staining and slide 
reading, following standard operational procedures, ac- 
cording to the Basic Laboratory Methods in Medical Para- 
sitology manual from WHO [44]. Field workers and 
microscopists were also trained on how to perform and 
read Paracheck-Pf 8 . All laboratory technicians were sup- 
plied with an operational procedures manual regarding la- 
boratory and field diagnosis. 

Microscopy 

Thick and thin blood smears were made on the same 
slide, air dried and transported to the CISA laboratory 
where they were stored. The slides were stained with 
10% Giemsa for 15 minutes and screened for P. falcip- 
arum parasites by two independent technicians (double- 
blind). Discordance in the diagnostic (positivity/negativity) 
was solved by a third reader and discordance in parasite 
counts was solved by calculating the mean of the two 
readings. The agreement between the two laboratory tech- 
nicians performing the 2 independent readings was 99.9%, 
Kappa = 0.997, P < 0.001. Assexual parasitaemia was quan- 
tified against 200 to 500 leucocytes, assuming a white 
blood cell count of 8,000/ul as recommended by WHO 
[45]. A slide was considered negative if no parasite was 
seen when 500 leucocytes were counted. Quality control 
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readings were performed in randomly selected samples by 
experienced CISA researchers. 

Paracheck-Pf® 

The Paracheck-PP test was performed accordingly to the 
manufacturer (Orchid Biomedical Systems, India). 

PCR assay (nested PCR for RNA (SSU-rRNA) amplification) 

Blood samples were spotted onto Whatman" 3MMChr fil- 
ter paper, air dried and stored at 4°C in the CISA labora- 
tory until DNA extraction. Total DNA was extracted 
using the QIAmp DNA Mini Kit (QIAGEN, UK), follow- 
ing the manufacturer's instructions. Nested PCR was 
performed using primers complementary to the Plasmo- 
dium small subunit ribosomal RNA (SSU-rRNA) gene, as 
described previously [35,46] and in detail by Fancony [43]. 

Statistical analysis 

Data were analysed using SAS 8 software version 9.3. Sensi- 
tivity, specificity, positive, and negative predictive values 
(PPV and NPV) of microscopy and Paracheck-PP , with 
PCR as the gold standard, were determined using 2x2 
contingency tables and compared using the McNemar's 
test (sensitivity and specificity) or the weighted generalized 
score Chi-squared test (PPV and NPV) for paired data 
[47]. Exact 95% confidence intervals (CI95) were calculated 
for each measure listed above. For each of the two diag- 
nostic techniques, the Pearson Chi-squared test was used 
to assess difference in sensitivity, specificity, and predictive 
values across the three age groups. Statistical significance 
was set at p < 0.05. 

Ethics approval 

Ethical approval was obtained from the Angolan Ministry 
of Health Ethics Committee. Written informed consent 
was obtained before inclusion in the study and anti- 
malarial treatment with ACTs was provided by a nurse or 
physician when participants had a positive rapid test re- 
sult. Participants who mentioned feeling unwell were ad- 
vised to go to the nearest health centre; those deemed 
with a serious illness were observed by the physician on 
site if present or transported by the research team to the 
reference hospital. 



Results 

Table 1 provides a matched-sample description of how 
microscopy and Paracheck-PP performed in relation to 
PCR as the gold standard. In 3,307 samples screened, 
525 (15.9%) were identified as positive P. falciparum in- 
fections by PCR and microscopy and 540 (16.3%) by 
Paracheck-PP. 

In direct comparison to microscopy, Paracheck-PP had 
significantly higher sensitivity, specificity and predictive 
values (Table 2). Microscopy correctiy identified 315 out 
of 525 PCR-positive P. falciparum infections (60.0% sensi- 
tivity, CI 95: 55.8-64.2) and 2,572 out of 2,782 PCR-negative 
samples (92.5% specificity, CI 95: 91.4-93.4), with a PPV of 
60.0% and NPV of 92.5%. Paracheck-PP correctly identi- 
fied 382 out of 525 PCR-positive P. falciparum infections 
(72.8% sensitivity, CI 95: 68.7-76.5) and 2,624 out of 2,782 
PCR-negative samples (94.3% specificity, CI 95: 93.4-95.2), 
with a PPV of 70.7% and NPV of 94.8% (Table 2). 

Table 3 shows how, for each diagnostic test, the mea- 
sures of performance varied across the different age 
groups. The sensitivity of microscopy was lower in mothers 
(36.8%, CI 95: 26.7-47.8) than in their children (68.4%, CI 95: 
61.9-74.5, in zero to five year-olds and 60.6%, CI 9 s : 53.7- 
67.2, in six to 15 year-olds) (p < 0.0001). No significant 
change in the specificity of microscopy was observed 
across the three age groups. Similarly, the sensitivity of 
Paracheck-PP was lower in mothers (43.7%, CI 95 . 33.1- 
54.7) than in their children (80.4%, CI 95: 74.7-85.4, in zero 
to five year-olds and 76.5%, CI 9 s : 70.3-82.1, in six to 
15 year-olds) (p < 0.0001) (Table 3). 

Discussion 

In this study, the prevalence values determined by micros- 
copy, RDTs and PCR were similar. However, compared to 
PCR as the gold standard, microscopy and Paracheck-PP 
detected only 60.0 and 72.8% of the true P. falciparum 
infections, respectively. In line with previous studies, para- 
site density might have determined the low proportion of 
positive infections detected by microscopy and RDT [17]. 
As discussed by Sousa-Figueiredo and colleagues, parasite 
density ranged from moderate to low, decreasing with 
older age [6]. Accordingly, the present study found that 
sensitivity of microscopy and RDTs decreased with older 



Table 1 Matched-sample description of the data 



Microscopy 

Positive 
Negative 
Total 



Paracheck-Pf® 
Positive 



297 
85 
382 



PCR positive 



Paracheck-PP 
Negative 



18 
125 
143 



Total 



315 
210 
525 



PCR negative 



Paracheck-Pf® 
Positive 



Paracheck-Pf® 
Negative 



62 
158 



114 
2,510 
2,624 



Total 

210 
2,572 
2,782 
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Table 2 Sensitivity, specificity, predictive values of microscopy and Paracheck- Pf® with PCR as gold standard 



PCR PCR Sensitivity % Specificity % PPV % NPV % 

Positive Negative (Cl 95 ) (Cl 95 ) (Cl 95 ) (Cl 95 ) 

(n = 525) (n = 2,782) 



Microscopy Positive 


315 210 


60.0 


92.5 


60.0 


92.5 


(n = 525) 




(55.8-64.2) 


(91.4-93.4) 


(55.7-64.2) 


(91.4-93.4) 


Negative 


210 2,572 










(n = 2,782) 












Paracheck- Pf 8 Positive 


382 158 


72.8 


94.3 


70.7 


94.8 


(n = 540) 




(68.7-76.5) 


(93.4-95.2) 


(66.7-74.6) 


(93.9-95.6) 


Negative 


143 2,624 










(n = 2,767) 














P-value* 


<0.0001 


<0.0001 


<0.0001 


<0.0001 


PPV: positive predictive value; NPV: negative predictive value. 
Clg 5 : 95% confidence interval. 

*0btained from McNemar test (sensitivity, specificity) / Weighted generalized score 


■ Chi-square test (PPV, NPV). 






age. This is also consistent with the fact that, in malaria- 
endemic countries, acquired immunity in adult individuals 
is associated with the presence of submicroscopic infec- 
tions that are more likely to be undetected by field micros- 
copy or RDTs [5,17,48-50]. On the other hand, false 
negatives found by Paracheck-Pf" may be explained by de- 
letions or mutations within the pfhrp-2 gene or by the 
prozone effect reported by others [21-25,51,52]. Neverthe- 
less, RDTs were significantly more sensitive than micros- 
copy, probably corroborating the ability of RDTs to detect 
parasites below the threshold of microscopy as previously 
described [15,53]. Additionally, the 8% false positives 


detected by microscopy may be explained by erroneous 
readings performed by the laboratory technicians, mis- 
takenly counting dirt, cell debris and stain artefacts as 
malaria parasites, whereas the false positives (6%) incor- 
rectly identified by Paracheck-Pf may be associated with 
persistent antigenicity from previous infections and with 
cross reactivity with autoantibodies, non-falciparum mal- 
aria and other infectious diseases [5,18,28,30,53-57]. This 
has resulted in similar specificity between RDTs and mi- 
croscopy albeit that those from RDTs were significandy 
higher. Given the results of sensitivity and specificity of 
microscopy in this study, using it as gold standard for 


Table 3 Sensitivity, specificity and predictive values of microscopy and Paracheck-Pf 8 by age group with PCR as 
gold standard 


Age 


Sensitivity % 


Specificity % 




PPV % 


NPV % 




(Cl 95 ) 


(Cl 95 ) 




(Cl 95 ) 


(Cl 95 ) 


Microscopy 0 - 5 


68.4 


92.7 




67.8 


92.9 




(61.9-745) 


(90.9-94.2) 




(61.3-73.9) 


(91.1-94.4) 


6 -15 


60.6 


91.6 




62.6 


91.0 




(53.7-67.2) 


(89.7-93.4) 




(55.6-69.3) 


(88.9-92.7) 


> 15 


36.8 


93.0 




34.8 


93.6 




(26.7-47.8) 


(91.1-94.6) 




(25.2-45.4) 


(91.7-95.1) 


P-value* 


<0.0001 


0.5032 




<0.0001 


0.0897 


Paracheck- Pf* 0-5 


80.4 


93.5 




73.6 


95.5 




(74.7-85.4) 


(91.8-95.0) 




(67.6-79.0) 


(94.0-96.7) 


6 - 15 


76.5 


93.3 




72.4 


94.5 




(70.3-82.1) 


(91.5-94.8) 




(66.1-78.2) 


(92.8-95.9) 


> 15 


43.7 


96.4 




55.1 


94.4 




(33.1-54.7) 


(94.9-97.5) 




(42.6-67.1) 


(92.7-95.9) 


P-value* 


<0.0001 


0.0064 




0.0088 


0.4946 



Age shown in years; PPV: positive predictive value; NPV: negative predictive value. 
Cl 95 : 95% confidence interval. 
*Obtained from Pearson Chi-squared test. 



Fancony ef al. Malaria Journal 2013, 12:284 
http://www.malariajournal.eom/content/12/1/284 



Page 5 of 7 



comparison would lead to the misclassification of samples 
(85 positive and 118 negative) and consequently mislead- 
ing evaluation of the performance of RDTs. It should be 
taken into account that even though laboratory techni- 
cians who participated in this study were retrained on 
malaria diagnosis their level of expertise was not formally 
assessed. Therefore further training and/or a stricter selec- 
tion of technicians could have increased the performance 
of microscopy. Despite providing reliable epidemiologic 
information, the use of PCR is less feasible in studies 
conducted in developing countries due to the high costs 
involved [1,40,58]. A pooled PCR, reported to be econom- 
ically more viable than individual PCR, would provide a 
feasible alternative for confirming prevalence of infections 
and evaluating the performance of RDTs or microscopy in 
determining malaria prevalence [1,58]. 

In conclusion, given the observed higher sensitivity, spe- 
cificity and predictive values of RDTs, the data presented 
here suggest that, for community-based surveys with simi- 
lar levels of endemicity and transmission rates and where 
adequate expert performance of microscopy is hard to ac- 
complish, the use of RDTs to determine the prevalence of 
P. falciparum infections is a preferable alternative, if para- 
site density does not need to be determined. In addition to 
the low cost and practicability of RDTs, the use of malaria 
HRP-2/pLDH (pan) combo tests would allow minimizing 
HRP-2 associated limitations such as false negativity, re- 
lated to gene deletions or prozone effect; and false positivity 
associated to persistent antigenicity, extending the feasibil- 
ity of their use in this context [59]. However both pLDH 
negative/HRP2 positive and pLDH positive/but HRP2 
negative tests would require PCR confirmation in order to: 
discriminate low parasite density from persistent antigenic- 
ity, and confirm the species involved, respectively. When 
microscopy is the diagnostic technique chosen, thus 
allowing for determining parasite density, these results sug- 
gest that training microscopists and establishing adequate 
quality control and assurance systems should be set as pri- 
orities, in order to guarantee an expert level of microscopy 
[45]. A systematic review of the publications comparing the 
performance of different diagnostic techniques in different 
endemicity and transmission intensity settings is warranted 
so that informed guidelines regarding the detection and 
control of Plasmodium infections can be developed. 
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